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(57)Abstract: 

PROBLEM TO BE SOLVED: To enable a viewer to 
convert received stereoscopic image data into data 
adapted to even a different display device and to 
reproduce the data, even if a different display device is 
connected to the viewer. 

SOLUTION: When a reception section 5 of a viewer 4 
receives compressed stereoscopic image data from a 
server 1 via a network 3, a video image reconfiguration 
section 6 expands the data and decodes the data 
according to a format instructed by the server. Then a 
stereoscopic video image configuration 7 discriminates 
which of prepared stereoscopic display devices is 
connected to the viewer 4, converts the reconfigured 
stereoscopic image data into data proper to the 
connected display device according to the discrimination 
result, and outputs the converted data to the connected 
stereoscopic video image display device, which displays 
the data. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to 3-dimensional scenography playback equipment. 

an output unit, a method for controlling the same, and a storage. 

[0002] 

[Description of the Prior Art]The applicant for this patent delivered inputted real time data, such 
as video information and speech information, to two or more clients via the information network, 
and already proposed partly the image transmission display system reproduced by a client side. 
Some already exist really. For example, they are Web View (Canon), RealVideo (RealNetworks), 
VDOLive (VDO network), etc. 

[0003]The Internet or what is called Intra networks, such as an enterprise network, which spread 
globally may be sufficient as the network in this case. In particular, by quality un-guaranteeing 
type network use like the Internet, for example to a communication bandwidth, since video 
information is large enough, by the time the inputted video information is reproduced, there may 
be delay or abandonment of data. 

[0004]Although the reproduced image etc. of the accumulated video are used for the input of the 

video information to a computer, the live image from a video camera is also used. 

[0005] 

[Problem(s) to be Solved by the Invention] However, since this conventional image transmission 
display system was made with the flat-surface image by two dimensions and depth sensation 
was not able to be displayed, there was a problem that force, presence, etc. were missing. 
Therefore, the image transmission display system which can make a three-dimensional display 
was called for. 

[0006]Now, the 3-dimensional scenography camera and the 3-dimensional scenography display 
are already used partly. Although it is technically possible to build a 3-dimensional scenography 
transmission display system by including these in an image transmission display system, a 3- 
dimensional scenography camera and a 3-dimensional scenography display do not correspond, 
and are not necessarily developed. Therefore, an image transmission display system 
corresponding to two or more kinds of 3-dimensional scenography displays is desired. 
[0007]In the case of the above 3-dimensional scenography transmission systems, each image 
data the object for right eyes and for left eyes does not receive simultaneously via a network, 
but that a proper corporal vision is not acquired eventually may arise in it. 
[0008] 

[Means for Solving the Problem]This invention is made in view of this point, and even if a 
different display device is connected, it tends to provide 3-dimensional scenography playback 
equipment which is used as stereo image data which was adapted for it. and is reproduced, a 
method for controlling the same, and a storage. 

[0009]Other inventions tend to provide a 3-dimensional scenography output unit which outputs a 
stereo image suitable for the above-mentioned 3-dimensional scenography playback equipment, 
a method for controlling the same, and a storage. 

[0010]In order to solve this technical problem. 3-dimensional scenography playback equipment 
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which realizes the 1 st invention, for example is provided with the following composition. Namely, 
a restoring means which restores stereo image data inputted as an input means which inputs 
compression stereo image data, A decision means which judges a type of a display device, and a 
conversion method which changes into form corresponding to a display device stereo image data 
restored by said restoring means based on a decision result of this decision means, It has an 
output means which outputs stereo image data changed by this conversion method to a display 
device. 
[0011] 

[Embodiment of the Invention] Hereafter, the embodiment which starts this invention according to 
an accompanying drawing is described in detail. 

[001 2] Drawing 1 is the figure which expressed the composition of this system roughly. The 
bookstand object image transmission display system has the server 1 which transmits 3- 
dimensional scenography, and composition which connected the viewer (cline) 4 which display 3- 
dimensional scenography in the network 3. The 3-dimensional scenography display is connected 
to the viewer 4. 

[0013]Next, the flow of picture image data is explained. The 3-dimensional scenography data 2 
which the server 1 sends out takes a synchronization, drops the image by the side of a left eye, 
and the image by the side of a right eye on one image, and it compresses them in order to pass 
the network 3. The server 1 transmits the 3-dimensional scenography data 2 to the network 3. 
[0014]The viewer 4 receives the data which flowed through the network 3. The viewer 4 
comprises three software modules, the data receiving section 5, the image reconfiguration part 6, 
and the 3-dimensional scenography formation part 7. The data receiving section 5 receives the 
3-dimensional scenography data 2 from the network 3, and passes it to the image reconfiguration 
part 6. The image reconfiguration part 6 reconstructs the data on the image of the original right- 
and-left mixing. 

[0015] Drawing 3 is an example of the reconstructed 3-dimensional scenography. When the 3- 
dimensional scenography format is included in the signal in the data transmitted by the server, it 
reconstructs in the format automatically. When format information is not included, it reconstructs 
to the format defined beforehand. The reconstructed image is passed to the 3-dimensional 
scenography formation part 7. 

[001 6]The 3-dimensional scenography formation part 7 constitutes and outputs an image to the 
format corresponding to the 3-dimensional scenography display of several kinds. When the 
format which the display by the side of a viewer treats is the same as the 3-dimensional 
scenography format sent from the server side, it can display as it is. There is little load of the 
graphic processing by the side of a viewer, and it ends. On the other hand, when formats differ, it 
changes into the format by the side of a viewer. 

[0017]In the embodiment, the following three 3-dimensional scenography display formats were 
adopted. Hereafter, this is explained. 

[0018]It is the format which outputs the image of a left eye to picture output left-hand side, and 
outputs the image of a right eye to picture output right-hand side like drawing 4 in the side-by- 
side split-screen format 8. When a constitution method is carried out based on the original 3- 
dimensional scenography of drawing 2 , a left eye image and a right eye image are started, 
respectively, variable power is carried out to a half in a transverse direction, and a left eye image 
is arranged on the left-hand side of a picture output, and arranges a right eye image on the 
right-hand side of [ picture output ] the position corresponding to a left eye image. This image is 
sent to the side-by-sidesplit-screen 3-dimensional scenography display 1 1, and a 3-dimensional 
scenography display is performed. 

[0019]It is the format which outputs the image of a left eye to the picture output upper part, and 
outputs the image of a right eye to the picture output bottom like drawing 5 in the top-down 
split-screen format 9. When a constitution method is carried out based on the original 3- 
dimensional scenography of drawing 3 , a left eye image and a right eye image are started, 
respectively, and it compresses into a half in a lengthwise direction, and a left eye image is 
arranged to the picture output up side, and arranges a right eye image to the picture output 
down side of the position corresponding to a left eye image. This image is sent to the top-down 
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split-screen S'-dimensional scenography display 12, and a 3-dimensional scenography display is 
performed. 

[0020]It is the format which outputs the image of a left eye right eye to a parity for every 
horizontal line like drawing 6 in the line sequential format 10. When it carries out based on the 
original 3-dimensional scenography of drawing 3, it starts a left eye image and a right eye image, 
respectively, and a constitution method compresses them into a half in a lengthwise direction, is 
taken [ of one line ] out horizontally further, respectively, and arranges a left eye image and a 
right eye image for each every horizontal line to a parity. This image is sent to the line sequential 
3-dimensional scenography display 13, and a 3-dimensional scenography display is performed. 
[0021]The program by the side of the above-mentioned viewer is supplied to the viewer 4 by 
media, such as a floppy disk. Drawin g 2 expressed it. The viewer 4 comprises CPU 14, HDD(hard 
disk drive) 15, 1/016, the memory 17, NetworkI/F18, and FDD(floppy disk drive)19 grade, and is 
connected to the network 3. The floppy disk 20 containing a program supplies a program to 
HDD 15 and the memory 17 through FDD 19. 

[0022]As shown also in this figure, it is realizable in a viewer being also with general-purpose 
information processors, such as a personal computer. 

[0023] Drawing 9 is a flow chart which shows the procedure by the side of a viewer. 
[0024]First, the data transmitted from the server is received at Step SI. And the data which he. 
followed to Step S2 and was received is elongated, and picture image data is reconstructed 
according to the format included in it. 

[0025]The display device connected now is judged in Step S3. This shall register **** and shall 
judge what kind of display device is beforehand connected to the device of a viewer by reading 
to it. 

[0026] Since three kinds are supported as a kind of display device in the case of an embodiment 
as explained previously, according to a decision result, it branches to step S4 - either of six, and 
changes into the stereo-images information corresponding to each display device.. And the 
changed stereo image is outputted to each output unit by Step S7 - either of nine. And the 
processing after Step SI will be repeated. 

[0027] Drawing 7 expresises an example of the image conversion route from the 3-dimensional 
scenography camera 21 to the server 1. The 3~dimensional scenography camera 21 is provided 
with two imaging means, and performs the output of the left eye video signal 22 and the right eye 
video signal 23 by each. Both signals are inputted into the video composition system 24, are 
compounded, and are outputted as the one 3-dimensional scenography signal 25 (for example, 
the picture of two sheets which is a stereo image is compressed into one half in the sliding 
direction, it is connected up and down, and the image of one sheet is constituted). The 3- 
dimensional scenography signal 25 is inputted into the server 1. The server 1 is constituted by 
two software modules, the data compression part 26 and the data transmission part 27. The data 
compression part 26 compresses the received 3-dimensional scenography signal 25, and passes 
it to the data transmission part 27. The data transmission part 20 receives the compressed 
signal, and transmits to the network 3, 

[0028]The video composition system 24 comprises software for performing 1 . picture composite 
machine 2. image variable power machine + picture composite machine 3. image variable power 
composition. 1.2. is hardware and 3. is a thing of software. However, 1.2 may be built in the 3- 
dimensional scenography camera 14. 3 may be contained in the server 1. 

[0029]The program by the side of the above-mentioned server is supplied to a server by media, 
such as a floppy disk. Drawing 8 expressed it. A server comprises CPU 14, HDD(hard disk drive) 
15, I/016, the memory 17, Networkl/FI 8, and FDD(floppy disk drive)19 grade, and is connected 
to the video composition system 24 and the network 3. The floppy disk 20 containing a program 
supplies a program to HDD 15 and the memory 17 through FDD 19. 

[0030]Although the 3-dimensional scenography camera was used as an input device of the 3- 
dimensional scenography by the side of a server, 3-dimensional scenography is incorporated 
from a file instead of a 3-dimensional scenography camera, and it may be made to transmit it in 
the above-mentioned embodiment. 

[0031] Although the file containing 3-dimensional scenography was put on the server side, it puts 
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on the viewer side and may be made to reproduce S-dimensional scenography, without going via 
a network. 

[0032]As the above-mentioned embodiment explained, a server and a viewer (client) can set 
general-purpose information processors of what needs a certain amount of hardwares/such as a 
network interface and a camera, such as a personal computer, as the foundation, and can 
operate further again. 

[0033]This invention therefore, the storage which recorded the program code of the software 
which realizes the function of an embodiment mentioned above^ It cannot be overemphasized 
that it is attained, also when a system or a device is supplied and the computer (or CPU and 
MPU) of the system or a device reads and executes the program code stored in the storage. 
[0034]In this case, the function of an embodiment which the program code itself read from the 
storage mentioned above will be realized, and the storage which memorized that program code 
will constitute this invention. 

[0035]As a storage for supplying a program code, a floppy disk, a hard disk, an optical disc, a 
magneto-optical disc, CD-ROM, CD-R, magnetic tape, a nonvolatile memory card, ROM, etc. can 
be used, for example. 

[0036] By executing the program code which the computer read. Based on directions of the 
program code the function of an embodiment mentioned above is not only realized, but. It cannot 
be overemphasized that it is contained also when the function of an embodiment which 
performed a part or all of processing that OS (operating system) etc. which are working on a 
computer are actual, and was mentioned above by the processing is realized. 
[0037]After the program code read from the storage was written in the memory with which the 
function expansion unit connected to the expansion board inserted in the computer or the 
computer is equipped. It cannot be overemphasized that it is contained also when the function of 
an embodiment which performed a part or all of processing that CPU etc. with which the 
expansion board and function expansion unit are equipped are actual, based on directions of the 
program code, and was mentioned above by the processing is realized. 
[0038] 

[Effect of the Invention]As explained above, according to this invention, whether a different 
display device is connected or it is the image data through a quality un-guaranteeing type 
network, it becomes possible to make it the stereo image data which was adapted for it, and to 
reproduce. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]3-dimensional scenography playback equipment comprising: 

A restoring means which restores stereo image data inputted as an input means which inputs 
compression stereo image data. 

A decision means which judges a type of a display device. 

A conversion method which changes into form corresponding to a display device stereo image 
data restored by said restoring means based on a decision result of this decision means.- 
An output means which outputs stereo image data changed by this conversion method to a 
display device. 

[Claim 2]A 3-dimensional scenography receiving set given in the 1st paragraph of a claim, 
wherein said input means is a means to receive via a network line. 

[Claim 3]3-dimensional scenography playback equipment given in the 1st paragraph of a claim, 
wherein said input means is a means read from a file. 

[Claim 4] A control method of 3-dimensional scenography playback equipment characterized by 
comprising the following. 

A restoration process which restores stereo image data inputted as an input process which 

inputs compression stereo image data. 

A deciding step which judges a type of a display device. 

A converting process which changes into form corresponding to a display device stereo image 
data restored by said restoration process based on a decision result of this deciding step. 
An output process which outputs stereo image data changed by thjs converting process to a 
display device. 

[Claim 5]A storage which stored a program code corresponding to each process according to 
claim 4. 

[Claim 6]A 3-dimensional scenography output unit comprising: 

An input means which inputs image data picturized by two imaging means as a stereo image. 
A synthesizing means which compounds an inputted stereo image in a picture of one sheet. 
A means to compress image composing. 
An output means which outputs compressed image data. 

[Claim 7]A 3-dimensional scenography output unit given in the 6th paragraph of a claim, wherein 
said output means is a means to transmit to playback equipment connected on a predetermined 
network line. 

[Claim 8]A 3-dimensional scenography output unit given in the 6th paragraph of a claim, wherein 
said output means is a means to store in a file storage means as a file. 
[Claim 9]A control method of a 3-dimensional scenography output unit characterized by 
comprising the following. 

An input process which inputs image data picturized by two imaging means as a stereo image. 
A synthesizing process which compounds an inputted stereo image in a picture of one sheet. 
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A process of compressing image composing. 

An output process which outputs compressed image data. 

[Claim 10]A storage storing a program code corresponding to each process according to claim 9. 
[Claim 11 ]A 3-dimensional scenography output unit comprising: 

An input means which inputs image data picturized by two imaging means as a stereo image. 
A means which combines a picture from two inputted imaging means. 

An output means which outputs a picture combined by said combination means to a quality un- 
guaranteeing type network. 

[Claim 12] A 3-dimensional scenography output unit given in the 1 1th paragraph of a claim, 
wherein a said quality un-guaranteeing type network is the Internet. 



[Translation done.] 
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DRAWINGS 



[Drawing 1] 
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[Drawin g 9] 
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